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Abstract 

The  expectations  and  £^[^(1)]  of  the  minimum  of  n  independent  geometric,  modified 

geometric,  or  exponential  random  variables  with  matching  expectations  differ.  We  show  how  this 
is  accounted  for  by  stochastic  variability  and  how  equals  the  expected  number  of 

ties  at  the  minimum  for  the  geometric  random  variables.  We  then  introduce  the  “shifted  geometric 
distribution”,  and  show  that  there  is  a  unique  value  of  the  shift  for  which  the  individual  shifted 
geometric  and  exponential  random  variables  match  expectations  both  individually  and  in  their 
miniinums. 
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1  Introduction 


The  purpose  of  this  note  is  to  compare  the  distributions  of  the  minimums  of  two  sets  of  random  vari¬ 
ables,  respectively  with  geometric  and  exponential  distributions,  having  pairwise  matching  means. 
The  geometric  distribution  is  the  discrete  analog  of  the  exponential  distribution  and  can  be  applied 
to  a  variety  of  performance  models  which  can  be  analyzed  by  analytic  or  simulation  methods.  The 
following  notation  is  used: 

•  IN  =  {0, 1,2, . . .},  the  natural  numbers. 

•  IN'*"  =  {1,2,3, .. .},  the  positive  natural  numbers. 

•  ^  =  {1,2, . . ., 7t},  the  first  n  natural  numbers  {n  is  a  constant  which  will  be  clear  from  the 
context). 

•  FA{t)  =  Pr{i4  <  a),  the  cumulative  distribution  function  (CDF)  of  a  random  variable  A. 

•  F>i(t)  =  1  -  the  complement  of  the  CDF  of  A  (its  survivor  function). 


2  Geometric,  modified  geometric,  and  exponential  distributions 

Two  random  variables  X  and  Z  are  said  to  have  a  geometric  distribution  with  parameter  a  6  (0, 1), 
X  ~  Geom(o),  and  a  modified  geometric  distribution  with  parameter /3  6  (0, 1),  2^  ~  ModGeom(/3), 
[4]  if  their  probability  mass  functions  (pmfs)  are,  respectively, 

VA;elN+,Pr{.Y  =  Ar}  =  a(l-o)*-’  and 

VA:€lN,Pr{Z  =  jt}  =  /3(l-/3)*, 

from  which  it  follows  that  their  CDFs  at  the  mass  values  are 

k 

Vfc  e  lN+,Pr{A'  <k}  =  5^a(l  -o)'-’  =  1  -  (1  -o)''  and 

i=\ 


k 

y/k  e  IN,  Pr{Z  <  k}  =  5;/?(l  -  /3)'  =  1  -  (1  -  /?)'=+’, 

t=0 

and  that  their  expectations  are 


1 

F[X]  =  ^  fca(l  -  a)*”’  =  —  and 


°°  1/3 

£[Z]  =  53A:/3(1-/8)*  =  -^. 

k=0  ^ 

Informally,  the  difference  between  a  geometric  and  a  modified  geometric  distribution  with  the 
same  parameter  is  the  way  in  which  they  count:  the  geometric  distribution  starts  at  one,  the 
modified  geometric  distribution  starts  at  zero.  Hence,  if  ~  Geom(a),  A  —  1  ~  ModGeom(a). 
Equivalently,  the  geometric  distribution  models  the  trial  number  of  the  first  “success”  in  repeated 
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independent  Bernoulli  trials,  whereas  the  modified  geometric  distribution  models  the  number  of 
trials  before  the  first  success. 

The  above  assumes  that  the  “time-step”  of  the  distribution  is  the  same  as  the  units  in  which 
time  is  measured.  This  restriction  is  removed  by  considering  X  and  Z  as  random  variables  assuming 
values  in  {ku>  :  k  €  IN'*"}  or  {ku  :  Ar  G  IN},  respectively,  for  some  time-step  u  >  0: 


-Y  ~  Geom(a,w)  Vt  6  IR,  Pr{A^ 


-(l-a)l.«J  ift>0 


otherwise 


Z  ~  ModGeom(/i,a;)  <=>•  Vt  €  IR,  Pr{Z  <  t) 


■Ir 


-  (1 -/?)!. ift>0 


otherwise 


which  imply 


VA-  €  IN+,  Pr{A-  =  Aw)  =  o(l  -  o)*'-*  and 
VA  G  IN,  Pt{Z  =  Aw}  =  /3(1  -  /J)*' 


E[X]  =  -  and 
a 


EIZ]  = 


It  is  well  known  that  both  the  geometric  and  modified  geometric  distributions  are  discrete 
analogs  of  the  exponential  distribution.  In  particular,  given  an  exponential  random  variable  Y 
with  rate  A  >  0, 


Y  ~  Expo(A)  ^  Vt  >  0,Pr{y  <  t}  =  1  -  €-^^=>E[Y]  =  X-\ 


one  can  determine  a  and  li  so  that  X  and  Z  match  Y  in  expectation: 

E[X]  =  ^  =  A-'  =  E[Y]  =►  Q  =  Aw  and 

and  then,  using  these  values  for  q  and  /i,  the  distributions  of  X  and  Z  approximate  that  of  Y 
arbitrarily  well  as  the  time-step  w  is  reduced: 

Um  Pr{A'  <  <}  =  lim  1  -  (1  -  Aw)L«J  =  1  —  =  PrlV  <  t}  and 

u/JO  u/10 


lim  ?t{Z  <  t}  =  Um  1  -  f  1  -  =  1  -  =  Pr{y  <  t}, 

Note  that  o  =  Aw  G  (0, 1)  impUes  w  <  A“*,  that  is,  it  is  not  possible  to  match  the  mean  of  an 
exponential  random  variable  Y  ~  Expo(A)  with  a  geometric  random  variable  having  a  time-step 
w  >  A"' .  In  the  special  case  w  =  A“’,  o  =  1  and  the  distribution  of  X  degenerates  to  a  constant: 
X  ~  Geom(l,w)  =  Const(w).  In  the  following,  we  allow  this  case  and  require  w  G  (0,  A“'].  No 
such  restriction  exists  in  the  case  of  the  modified  geometric  distribution,  where  any  w  >  U  can  be 
used. 
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3  The  minimum  of  a  set  of  random  variables 

(Consider  now  three  sets  of  n  >  2  independent  random  variables,  {X;  :  i  €  N),  {Zi  :  i  €  N},  and 
{V^  ;  t  €  iV}  with  matching  means: 

Vt  6  N,  Xi  ~  Ci’eom(a,,u>),  E[X^  =  A"’  =»  o,  =  A^a;, 

Vi  €  jV,  Z.  ~  ModGeom(A,u)),  E[Zi\  =  A"’  =>  /i.  =  -  ,  and 

1  +  X{{jj 

Vi  eN,Yi^  Expo(A.),  £[y;]  =  a,-’. 

Since  u  6  flteNlO’  obtain  w  €  (0,  where  Xmax  =  max{A,  :  i  6  ^}. 

It  is  well  known  that  the  minimum  of  each  of  these  sets  has  the  same  type  of  distribution  as 
the  elements  of  the  set  [5,  2]: 

Af(i)  =  min{A',  :  t  6  X)  ~  Geom  |  1  —  JJ(1  -  o«),w|  > 

\  »€N  / 

Z(,j  =  min{Zi  :  i  €  X}  ~  ModGeom  1 1  -  JJ(1  -  | ,  and 

\  igN  / 

Vji)  =  min{Vi  :  i  €  X}  ~  Expo  A,^  . 

Hence,  Ar(i),  Z(i),  and  V(i)  have  different  expectations: 

E[X(1)1  = - - - = - ^ =E[y(,)]  and  (1) 


l-n(^-0i)  -l  +  Hil  +  Xiu;) 

i€/v  I'e/v 


(ea.)'’  = 

\.6N  / 


Theorem  1.  For  n  >  2,  £[X(i)]  >  E[y(i)]  >  E[Z(i)). 

Proof.  We  prove  that  £^[Af(i)]  >  by  induction  on  n,  hence  we  make  the  index  n  explicit 

by  writing  £’[A'(,,„)]  and 

Base  step:  For  ii  =  2, 

^  1  -(1  -  Aiu;)(l  -  X-iUj)  A,  +A2- A,A2u;  ^  A,  +  A2 
Inductive  Hypothesis:  Assume  that,  for  a  given  n,  £J[A'(i  „)]  >  Thm, 

.  nn 

i  “  11(J  -  Xiuj)  \,gyv  /  ie/v  ie/v 
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Geometric 


Exponential 
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Modified  Geometric 


Figuro  1:  and  £[Z(|)]  (v  =  I ,  •  •  • . 5.  V/.  A,  =  1 )  as  a  fimrtion  of 

Inductive  Step:  Then  since 


The  proof  that  E[Z(\-^  <  CfV'ji)]  is  analogous  and  is  omitted.  QED. 

In  other  words,  the  minimum  of  n  independent  exponential  random  variables  is  always  strictly 
bounded  in  expectation  by  the  minimums  of  v  independent  geometric  and  modified  geometric 
random  variables  with  matching  means.  For  example,  if  n  =  2,  and  A]  =  A2  =  A, 


E[.V(,)]  =  (2A(1  -  Aa;/2))-'  >  E[Yi,^]  =  (2Ar’  >  £[Z„)]  =  (2A(1  +  A,*;/2))-' 
El-Yfi)]  and  E[Z^^\^]  coincide  with  only  in  the  limit,  as  u)  1  0  (see  figure  1): 


lim  ETYm)]  =  lim - 5=?— -  =  bm  - — - 

..10  ^10  1  _  JJ{1  _  A.u;)  '^lo^A.w  +  ofc 


-I 


•e-v 


le.v 


16/V 

lim 


-1 


lim  EfZdi]  =  lim - == -  —  .....  ^  i  ^ 

U.10  ^  U.10  _i  +  JJ(1  +  A.u;)  -10  A.u;  +  o(u;)  , 

ig;V  I'eN 

The  convergence  of  EfA’j])]  and  f'fZji)]  to  £^[>(|j]  as  u;  1  0  can  also  be  derived  observing  that 


^  <  ^[^’(1)]  <  ^[-'(1)]  <  E[Z(\)]  +  u). 


which  follows  from  the  fact  that  (A',  -  u;)  ~  ModCJeom(o,,u;)  and  (Z,  +  ~  CJeom(/f,,u;).  and 

from  Vi  G  iV.  o,  <  fi,,  which  imply  that  ^[A’  (,)  -u}]<  i:[Z(,)]  and  £[Z(,)  +  w]  >  Ef-Y,,)]. 

The  next  section  contains  an  explanation  for  these  inerpialities. 
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4  Stochastic  variability 


Randoin  variables  with  the  same  mean  can  be  compared  using  the  notion  of  stochastic  variability, 
described  in  Ross  [3],  for  which  there  are  two  equivalent  definitions.  V  is  said  to  be  stochastically 
more  variable  than  A',  A'  <v  V,  if 

V  increasing  convex  function  g,  £lff(X)]  <  Elff(y)] 

or,  equivalently,  if 

Vo  >  0,  /  Fx(t)  dt<  Frit)  dt. 

Ja  Ja 

An  additional  useful  notion  codifies  the  idea  that  the  remaining  lifetime  of  a  random  variable 
conditioned  on  exceeding  some  value  a  has  never  greater  expectation  (NBUE:  New  Better  Than 
Used  in  Expectation),  or  never  smaller  expectation  (NWUE:  New  Worse  Than  Used  in  Expecta¬ 
tion),  than  the  original  lifetime.  Formally,  a  nonnegative  random  variable  A  is  NBUE  if 

Va  >  0,  E[A  -  a  I  A  >  a]  <  E[A] 

and  is  NWUE  if 

Va  >  0,  E[A  -  a  I  A  >  a]  >  ^'[A]. 

Ross  lists  some  important  consequences  of  these  definitions: 

•  If  .V  and  Y  are  nonnegative.  A’  <v  K,  and  E[X]  =  E[Y],  then  -X  <v  -Y. 

•  U  g  :  IR"  -♦  IR  is  an  increasing  convex  function,  if  Vr  G  A,  A,  <v  K,  {A,  :  i  G  A}  are 
independent,  and  {V^  :  i  G  N}  are  independent,  then 

j7(A,,A2,...,A„)  <v  g{YuYi . T„). 


•  If  A  is  NBUE,  and  Y  is  exponential  with  the  same  mean  as  A,  then  A  <v  Y . 

•  If  Z  if  NWUE  and  Y  is  exponential  with  the  same  mean  as  Z  then  Y  <v  Z. 


These  last  two  facts  are  used  to  relate  A  ~  Geom(tt,u;),  Z  ~  ModGeom(/i,uj),  and  Y  ~  Expo(A) 
with  the  same  mean,  by  showing  that  the  geometric  distribution  is  NBUE  and  that  the  modified 
geometric  distribution  is  NWUE.  Let  A  ~  Geom(a,u;),  Z  ~  ModGeom{/i,u;),  and  choose  any 
a  >  0.  Using  the  memoryless  property  of  the  geometric  distribution,  we  can  derive: 


E[X-a\X  >a] 
E[Z  -  a  \  Z  >  a] 


£;[A  I  A  >  a]  -  a  =  0/  -f  E[X]  -a<  E[X]  and 

E[Z  I  Z  >  a]  -  a  =  ([5J  -I-  l^c^+E[Z]-a>  E[Z]. 


Therefore,  A  <v  T  <v  Z- 

(Considering  again  the  three  sets  of  independent  random  variables  with  matching  means  {A,  : 
i  G  A},  {Z,  :  i  G  A},  and  {Yi  :  i  €  A}  observe  that 


min{ai  :  t  G  A}  =  —  max{— a,  :  t  G  A}. 
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Since  max  is  an  increasing  convex  function  and  Vi  6  N,  -Xi  <v  -  Yi  <v  -Zi, 
niax{-A',  :  i  €  N)  <y  uiax{-yi  :i  €  N}  <y  iuax{-Zi  :  i  €  N}, 

implying  that 

-£[max{-A',  :  i  €  ^}]  >  -£[max{-yi  :  i  €  >  - E[mAx{  - Z,  :  i  e  A^}], 

and  thus  that 

f;[min{A:,  :  t  €  N}]  =  C(X(,)]  >  £;[min{yi  :i€  N}]=  >  E[inin{Z,  ;  t  €  N}]  =  E[Z(,)]. 

5  Matching  the  minimums  by  changing  the  time-step 

This  section  presents  an  explanation  for  the  existence  of  the  strict  Inequality  (1),  and  its  quantifi¬ 
cation,  based  on  the  possibility  of  a  tie  for  the  minimum  in  the  set  :  i  6  N}.  A  confirmation 
of  this  intuition  is  found  by  defining  a  new  random  variable,  Vy{i),  obtained  dividing  A(i)  by  the 
expected  number  of  random  variables  tied  for  the  minimum:  the  expectation  of  this  “weighted 
minimum”  is  indeed  the  same  as  that  of  V(|). 

The  discrete  nature  of  the  geometric  distribution  implies  that  several  random  variables  in 
{A,  :  i  €  N}  might  coincide  with  A(i).  Define  /jij  to  be  the  the  set  of  indices  among  {!,...«} 
corresponding  to  such  random  variables  (/(ij  is  itself  random): 

/(,]  =  {*€  A:A,  =  A(,)}C 

The  pmf  of  /[jj  is 

v.s  C  A,  .S  yt  0,  Pr{/(,J  =  .s)  =  Pr{Vi  €  «,  A.  =  A(,)  A  V j  €  A  \  s,  Xj  >  A(,)} 

OO 

=  ^  =  /kw  A  Vj  €  A  \  s,  Xj  >  ku} 

k=^ 

=  n  (>-“-)*] 

fc=l  V«e*  /  \j€N\s  J 

k=l  \.e»  /  \j^N\s  /  \leN  ) 


l-llil-a,) 


leN 

This  result  is  more  easily  obtained  observing  that,  because  of  the  absence  of  memory  of  the  geo¬ 
metric  distribution,  /[jj  and  A(i)  are  independent,  hence  Pr{/[ij  =  s}  is  simply  the  product  of  the 
one-step  probability  of  success  for  the  elements  of  »•<  and  of  the  one-step  probability  of  failure  for 
the  elements  not  in  s,  normalized  by  the  probability  that  at  least  one  success  occurs. 
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For  example,  if  n  =  2,  the  three  possible  values  for  /(jj  and  their  probabilities  are: 
D.i  I _ ®i(l  —  ^i)  _  -^1  ~  Aj  Ajo; 


1-(1 

aa) 

Ai 

+ 

X2  —  A|  A2u^ 

ft2(l  -  ttl) 

Ai 

—  A]  X'iUf 

1-(1 

-o,)(l  - 

a-i)  ~ 

Ai 

A-2  —  A|A2<<fc^ 

Ol«2 

Aj  X-2(jJ 

1-(1 

-o,)(l  - 

02) 

Ai 

A2  ~  Ai  AiW 

=  {>,2))  =  Pr(2f,  =  X.}  = 

In  general,  the  probability  that  a  particular  A",  is  equal  or  that  i  6  /(ij,  is 

OO 

Pr{  A.  =  A(,)}  =  53  Pr{A.  =  kcj  A  Vj  G  A,  j  /  i,  Xj  >  ku} 
k=\ 

OO 

=  £«•(>-»•)*■'  n  (!-“)>*■' 

^•=1  j€N,j^i 

OO 

=  E“.  11(1 -«.)*■' 

/(.•=i  j€\ 

i-n(i-«i)’ 

jeN 

hence,  the  expected  number  of  completions  at  time  A(|)  among  {A,  :  t  G  N)  is 

E“. 

£[K|.|II  =  E  =  X|,|)  =  — 

ie/v  i-ll(i-oi) 

We  can  define  the  “weighted”  random  variables  {VF<  :  i  G  A),  where 

X  /  \  f  i-no-o.A 

V  igyv 

which  are  still  geometrically  distributed  random  variables  with  the  same  success  probabilities  as 
their  original  counterparts  {A^  :  t  €  A},  but  with  a  reduced  time-step.  Then, 

=  .nin{K^,  :  i  €  A-)  =  mi„  {^  :  i  .  A-}  = 

takes  into  account  simultaneous  completions  by  dividing  the  minimum  completion  time  by  the 
expected  number  of  completions  (the  corresponding  quantity  for  the  continuous  case  is  still  simply 
Vji),  since  the  probability  of  simultaneous  completions  is  zero  in  this  case).  The  expected  value 
of  the  weighted  minimum  for  the  geometric  case  coincides  with  the  expected  minimum  for  the 
exponential  case: 

u 


E[W(i)]  =  E 


-Ell/l.llj)  - 


Geom  I  ai,u; 


1- 

ieN 

ijj 

(Ea,)“ 

E». 

ieN 

'  Eo.  ■ 

i^N 

1- 

jeN 
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We  conclude  this  section  by  observing  that,  while  the  result  =  £^[^(1)]  seems  to  imply 

that  exact  ties  are  the  cause  of  Inequality  (1),  this  is  not  correct,  since  the  inequality  holds  even 
when  ties  are  not  possible.  This  can  be  shown  by  considering  a  set  of  geometric  random  variables 
{X*  :  i  e  N},  where 

Vi  €  N,  X*  ~  Geom(«;,a;i),  =  ^  =  A,*’  =  E[Y,] 

and,  Vi  €  iV,Vj  6  JV, t  ^  j,  the  ratio  Uifuj  is  not  a  rational  number,  hence,  it  is  not  possible  to 
find  two  integers  ki  and  kj  that  would  results  in  a  potential  tie  at  time  Ar.Wj  =  kjujj. 


6  Matching  the  minimums  by  time-shifting 

In  the  previous  section,  we  forced  the  expectation  of  the  minimums  of  {Xj  :  i  £  N}  and  {Vi  : 
i  £  N}  to  coincide  by  reducing  the  time-step  of  the  geometric  distributions,  that  is,  transforming 
{Xi  :  i  £  N}  into  {W,  :  t  £  N}.  While  the  result  is  appealing,  the  weighted 

random  variables  :  i  €  X}  do  not  match  the  original  :  i  6  X}  in  expectation.  A  more 
interesting  result  would  be  to  modify  our  initial  set  of  random  variables  {X,  :  t  6  X}  so  that  both 
the  individual  random  variables  and  the  minimum  match  the  corresponding  exponential  quantities 
in  expectation. 

In  this  section,  we  accomplish  exactly  this  by  introducing  the  “shifted  geometric”  distribution, 
a  generalization  of  both  the  geometric  and  modified  geometric  distribution.  Given  0  <  a  <  1, 
w  >  0,  and  <t  €  IR,  we  say  that  5  has  a  shifted  geometric  distribution  with  parameters  o,  and 
<T,  S  ~  ShiftGeom(a,u;,<r),  if  its  pmf  is 

\/k  £  IN,  Pr{5  =-■  few  (t)  =  o(l  -  tt)*' 


which  implies  that  its  CDF  is 


Vt  €  IR,  Pr{5  <t}  = 


—  (1  —  a)l  "  if  t  >  (T 


otherwise 


and  that  its  expectation  is 


£[5]  =  - — ^u;  +  (7. 
o 


In  other  words,  given  a  random  variable  A  ~  ModGeom(a),  u>  >  0,  and  (t  G  IR,  .5  =  Au  cr 
ShiftGeom(o,a;,(T).  Figure  2  shows  the  relationships  between  the  geometric,  modified  geometric, 
shifted  geometric,  and  exponential  distributions. 

Given  Y  ~  Expo(A),  we  can  again  consider  the  condition  under  which  5  and  Y  have  the  same 
expectation: 

+  ,  =  (3) 

Since  a  is  a  probability,  it  can  only  have  values  in  (0, 1].  Furthermore,  £[5]  =  oo  when  a  =  0,  so 
we  exclude  this  case.  Then,  5  and  Y  have  the  same  expectation  for  any  choice  of  u  and  <t,  as  long 


0  <  O  =  - - r - -  <  1  =>  (T  <  A  * 

1  —  <tA  -f-  wA 

and  a  is  set  according  to  Equation  (3).  A  few  observations  are  of  particular  interest: 
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Figure  2;  Relationships  between  the  distributions  discussed  in  this  paper. 


•  Once  the  value  of  £[5]  is  fixed  at  decreasing  the  time-shift  ct  by  6,  possibly  below  zero, 
causes  a  decrease  in  o,  so  that  E[A]  increases  by  i/w  and  £^[5]  =  E[A]u-a  remains  constant. 
Since  E[A]  can  be  arbitrarily  large,  this  explains  why  there  is  no  lower  bound  for  a. 

•  If  <T  =  0,  5  ~  ModGeom(a,w). 

•  If  a;  <  and  cr  =  w,  5  ~  Geom(Q,a;). 

•  If  (T  =  A~',  a  =  1,  hence  S  ~  Const(<r)  =  Const(A~'). 

Consider  now  a  set  of  modified  geometric  random  variables  with  time-step  one,  {A,  :  i  €  /V} 
and  the  set  of  shifted  geometric  random  variables  {Si  :  i  ^  N}  obtained  from  them  by  changing 
the  time-step  to  u  and  applying  a  time-shift  a: 

Vi  6  N,  Ai  ~  ModGeom(ai), -1-  (t  =>  ~  ShiftGeom(oi,u;,  rr) 


and  set  the  parameters  {oj  :  i  €  iV}  so  that: 


Vi  6  N,  E[Si]  =  -b  a  =  A'*  =  E[Yi\  =>  a,  =  - - 

Oi  1  -  aXi  -I-  wA, 

Since  Vi  G  iV,  0  <  a,  <  1 ,  the  maximum  value  of  <r  is 


MAX- 


The  expectation  of  5(i)  =  min{5,  :  i  €.  N}  =  is  then 


£[5(,)]  = 


i€Af _ 

1- 

ieN 


a>  4-  <T 


9 


n(-rr^) 


u;  +  O’ 


where 


satisfy 


11(1 -^A.) 

- 'sa - a,  -cj  +  o 

n(i  —  ^tA|  -f“  cjA| )  —  nc  —  oAj)  <ln  —  Pn 

ieN  i^N 


Pri  =  n  ( ^  ~  =  n ( ^  ■*■  ) 

ieN  i€N 


•  Vo  <  ^XfAX'P'^  <  9»>- 

•  PnU=0  =  1>  9«U=0  =  n(^  >  1- 

i^N 

•  =  “• 

•  Ifw  <  ^'^AX'  9«l(,=w  =  *■ 

Theorem  2.  There  exists  a  unique  value  o*  <  X'j^xx  which  £^[.9(i)]  =  £^[K(i)]. 

Proof.  To  show  the  existence  of  o*,  it  is  sufficient  to  observe  that  £^[5(i)]  is  a  continuous  function 
of  o  over  (-oo,  Aj^*^;^],  that 


JJ(1  +  wA 

i^N 


—  <(£a,)  =E|y|„l 

« )  ~  *  \i€/V  / 


(this  is  Inequality  (2)),  and  that 


=  ^MAX  >  f  E  ^*1  = 

<'-^MAX  V.gyV  / 


Hence,  by  continuity,  there  must  exist  a  value  o*  €  satisfying 


Furthermore,  if  w  <  ^/J^X' 


n(l-u;Ai) 

I-n(l-u;Ai) 


+  w  = 


I  -  ri(i  - ‘‘^Aj) 

t€/V 


=£[/(„] 

»/  \i6/V  / 


(this  is  Inequality  (1)),  hence,  in  general,  o*  €  (0,min{u;,  }). 

We  prove  the  uniqueness  of  o*  by  induction  on  n,  showing  that  is  a  strictly  increasing 

function  of  o  over  (-oo,  hence  we  make  the  index  n  explicit  in  £^[5{i)]  by  writing^ 

^[•^(i,n)]  =  min{.yi :  t  €  iV}. 
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Base  step:  For  n  =  2, 

E[Si^,2)]  = 


_ (1  -  (rAi)(l  -  ffAj) _ ^  ^ 

(1  —  ctAi  +  u;Ai)(1  —  <tA2  +  wAj)  —  (1  —  (rAi)(l  —  <J’A2) 

I  +  (rAiA2(u;  -  cr) 

Aj  +  A2  +  AjA2(<*>  —  2fr) 


and 


^^[‘^(1 ,2)1  A]  A2(w( Ai  +  A2  ~  2A]  A2<^ )  +  2(  1  —  <tAi  —  <tA2  +  Ai  A2)  +  Aj  A2 ) 

do'  (Ai  +  A2  +  AiA2(u;  —  2(t))'^ 


>0  for  AX 


AiA2(w(A](1  —  <tA2)  +  A2(1  —  <tAi)  4-  2(1  —  (tAi)(1  —  <^A2)  +w^AiA2) 


In  particular, 


(A|  +  A2  +  AiA2(t4^  —  2(j)y^ 

lim  E[Si-i  2)]  =  -00  and  liin  — ^ 

<T— ►— 00  ^  00  dcT  2 


>  0. 


and 

mij}i 


IfTriA' 


=  A 


-1 

MAX 


and 


dE[S(,,j)] 


dcT 


U) 


l<r=A 


MAX 


MAX 

where  Xmin  =  min{Ai,A2}. 

Inductive  Hypothesis:  Assume  that,  for  a  given  n, 


^  +  ^MlN  ~  ^MAX  +  A 


(; 


iJ 


^MIN 


is  a  strictly  increasing  function  of  a  over  (-00,  A^'^;^],  that  is 

^  Pniqn  -  Pn)  -  Pn(9n  "  ,  ,  _  Pngn  -  Png,',  .  ,  .  o 

dcr  (9„  -  Pn)^  {qn  -  Pn)^ 

which  implies 

V<T  €  (-00,  u;(p;.g„  -  pnq'J  >  -(g„  -  p„)’^ 


Inductive  Step:  Then  the  same  holds  for  n  +  1,  that  is. 


^[■^(l,n+l)]  =  - - W  +  (7  = 


Pn(l  -  <’’An+l) 


-u;  +  cr. 


9n+i  -  Pn+1  ?7i(  1  —  cr A„^.i  +  wA„+i )  -  p„(  1  -  fr A„+i ) 

where  A,i+i  is  the  rate  of  the  (?t+l)-th  exponential  random  variable,  is  a  strictly  increasing  function 
of  cr  over  (-00, max{AA^>lx >  A„^.i }“'],  that  is 

>-*{gn“Pn)^  for 


_  (  1  -  <^A,t+i  )(  1  -  <tA„.h  +  fa>An-H  )  (Pn?n  -  Pn?'i  V  - Af.+  iCJ^g„Pn 


dcr 


{qni  I  -  <rA„+,  +  a;A,i+, )  -  p„(  1  -  rr  A„+i  ))2 
(1  -  gA„4,)(l  -  (7A„+i  +u>A„+i  )(-(?„  -  p„)'^)  -  Xl+^u'^qnPn  ^  j 
(9„(  1  -  <tA,i+i  +  u;A„+, )  -  p„(  1  -  <tA„+i  ))'^ 

A„+iw(g„  -  p„)((9n  +  Pn)(l  -  <^A„+i)  +  A,i+ia;g„ 


+  1 


(9„(  I  -  (tA,i+i  +  wA„+i )  -  p,i(  I  -  (tA„+i  ))2 


>  0 
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since,  a  <  and  Vcr  €  (-oo,max{AM/ix,A„+i}  *],q„  >  p„.  QED. 

We  might  now  ask  whether  this  value  a*  for  which  is  such  that  the  other  order 

statistics  coincide  as  well,  that  is,  whether 

VieN,i>i, 

This  is  indeed  true  for  n  =  2,  since 

£;[5(,)]  +  £[5(2)]  =  E[S,]  +  E[Si]  =  E[Y,]  +  £[^2]  =  £[V(i)]  +  ^2)] 
implies  that,  whenever  E[5(i)]  = 

£[%)]  =  £;(r(2)] 

Unfortunately,  this  is  not  true  in  general  for  n  >  3,  as  it  can  be  seen  considering  the  homogeneous 
case.  When  Vi  6  A,  =  A, 

Pr{.?(2)  >  +  <r}  =  Pr{/1(2)  > 

(Vi  €  N,Ai>  k)\/  l\J  (Ai  <kA  Vi  e  iV,i  /  i,  Aj  >  k) 

\i&N 

=  Pr  {Vi  eN,Ai>  A:}  +  Pr{>l,  <  A;  A  Vj  6  iV,i  #  i,  Aj  >  A-} 

ieN 

=  ((1  -«)")*■•+'  +n(l  -(1  -a)*'+')((l 
=  w(l  -  -  (n  -  1)(1  - 

and 

00 

^[4(2)]  =  Y^?r{A^,)>k} 

k=0 

00 

=  '£nil-  «)<”->»*'+*)  -  -  1)(1  - 

fc=o 

n(l  —  a)”~*  («  —  1)(1  —  a)’* 

1  -  ( 1  -  o)"->  1  -(1  -a)’‘ 

Hence,  considering  5^^^  =  '4(2)W  +  (t  and  substituting  a  from  (3), 

1  (  n{l-<rXr-^ _ {n-l){l-aXr  ] 

^P(2)l  ^(1  1  _(1  ( 1  -  trA  -  wA)’*  -  ( 1  -  trA)" / 

while,  due  to  the  absence  of  memory  of  the  exponential  distribution, 

£[y(2)]  =  (nA)-'+{(n-l)Ar^ 

It  can  be  easily  verified  numerically,  for  example  when  n  =  3,  w  =  1/2,  A  =  1,  that  the  only  real 
root  of  i5[5(i)]  =  £[^(1)]  is  <7  SB  0.173927,  while  the  only  real  root  less  than  A“*  of  -E[5(2)]  =  i5[y(2)] 
is  a  SB  0.346961. 
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7  Variate  generation  application 


The  results  of  Section  3  ran  be  used  in  variate  generation  for  Monte  Carlo  simulation.  For  brevity, 
only  the  geometric  distribution  is  considered.  Results  for  the  modified  geometric  and  shifted  geo¬ 
metric  distributions  are  similar. 

To  generate  a  single  Expo(A)  random  variate  V  by  inversion  [1] 

where  (/  ~  Unif(0, 1).  The  random  number  1  —  U  can  be  replaced  by  U  for  increased  speed 
although  the  direction  of  monotonicity  is  reversed.  If  K  ~  Expo(A)  then  fK]  ~  Geom(l  -  e~^) 
since  PrjfT]  =  k}  =  -  e~^)  for  k  6  IN’*".  Thus  to  generate  a  Geom(Q)  random  variate 

.V  requires  only  a  single  line  of  code 

rin(l-I/)1 
^  |ln(l-a)r 

If  the  time-step  is  w,  then  the  appropriate  modification  to  generate  a  Geom(a,a;)  random  variate 


The  straightforward  approach  to  generating  the  minimum  of  n  exponential  random  variables 

{Y,  Expo(Ai)  :  i  6  iV}  is  to  generate  n  exponential  variates  Vi,...,K„,  then  determine  the 
minininm  and  the  associated  index  (if  required).  This  approach  becomes  time  consuming  as  n 
increases.  A  much  faster  approach  is  to  generate  the  minimum  as 

ln(l-(/) 

ieN 

where  the  denominator  needs  to  be  computed  only  ooce.  This  approach  is  both  synchronized  (one 
random  variate  from  Unif(0, 1),  I/,  is  needed  to  generate  one  random  variate  for  and  monotone 
(given  two  random  variates  from  Unif(0, 1),  U\  and  U21  U\  <  U2'=>Y(\)x  <  ^(1)2)-  To  generate  a 
variate  corresponding  to  the  index  J  of  the  minimum  value,  use  the  pmf 

Pr{y  =  j)  = 

i^N 

for  j  6  N. 

There  are  two  cases  to  be  considered  when  generating  the  minimum  of  geometric  random  vari¬ 
ables.  The  first  is  when  the  modeler  wants  the  means  of  the  individual  random  variables  (but  not 
of  their  minimums)  to  match.  The  second  is  when  the  modeler  wants  the  means  of  the  minimums 
(but  not  of  the  individual  random  variables)  to  match.  Consider  generating  the  minimum  Af(i)  in 
the  first  case,  where  {Af,  ~  Geom(a,,uf) :  i  6  A^}.  First  generate  the  minimum 


^(1) 


Injl-U) 

5^1n(l-ai) 

i€N 
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To  generate  a  random  set  of  indices  /[j]  corresponding  to  completion  at  the  minimum  value,  use 
the  pmf 


III"*)  1  n  (1  -“j)) 

leN 

fOT  s  C  N,s  ^  0. 

There  are  two  costs  to  consider  when  generating  a  set  of  indices  corresponding  to  -V(i).  The 
first  cost  is  the  set-up  cost  incurred  once  at  the  beginning  of  a  simulation.  If  all  of  the  2"  -  1  subsets 
of  indices  are  to  be  considered,  the  (0, 1)  interval  must  be  partitioned  into  as  many  pieces  prior  to 
generating  any  variates.  The  second  cost,  often  called  the  marginal  cost  to  generate  a  variate,  is 
incurred  each  time  a  random  variate  is  generated.  It  involves  generating  a  Unif(0, 1)  variate  and 
searching  the  partition  determined  at  the  beginning  of  the  simulation  for  the  appropriate  cell.  This 
cell  corresponds  to  a  set  of  indices  for  the  generated  geometric  random  variable.  The  above  scenario 
is  worst-case,  since  time  will  be  saved  in  both  the  set-up  and  marginal  steps  if,  for  example,  the 
modeler  is  only  interested  in  whether  or  not  a  tie  occurred. 

The  generation  of  W(i),  where  the  expected  values  of  the  minimums  of  the  exponential  and 
geometric  random  variables  coincide,  requires  only  a  slight  modification  to  the  previous  approach. 
At  the  beginning  of  a  simulation,  £[|/[i]|]  should  be  calculated.  Thus  the  reduced  geometric  is 


where  is  generated  using  the  previous  technique. 


8  Conclusion 

We  have  shown  how,  if  the  random  variables  {A,  :  i  €  N},  {Vi  :  i  €  N},  and  {Zi  :  i  G  N} 
model  the  same  set  of  n  concurrent  activities  using  geometric,  exponential,  or  modified  geometric, 
distributions,  respectively,  with  given  expectations  {A“\  the  expected  value  of  the  minimums  are 
different,  >  E{Z^x^.  Stochastic  variability  is  employed  to  justify  the  result. 

We  then  consider  two  different  ways  to  match  the  expectation  of  the  minimums.  First,  by 
taking  into  account  the  possibility  of  ties  in  the  geometric  case,  we  define  the  “weighted  minimum” 
and  obtain  E[W(i)]  =  £[>(1)],  but  this  operation  corresponds  to  decreasing  the  time-step 
of  the  individual  geometric  distributions,  hence  their  expectation.  Alternatively,  we  introduce 
the  “shifted  geometric  distribution”,  which  a  generalizes  both  the  geometric  and  the  modified 
geometric.  We  can  then  define  a  set  of  shifted  geometric  random  variables  {5,  :  i  €  A},  which 
match  in  expectation  the  exponential  random  variables  both  individually,  £[5,]  =  A~^ ,  and  their 
minimum,  £[5(i)]  =  £[y(i)].  Generating  variates  is  straightforward. 

References 

[1]  L.  Devroye.  Non-Uniform  Random  Variate  Generation.  Springer- Verlag,  New  York,  NY,  1986. 


14 


[2]  B.  H.  Margolin  and  H.  S.  Winokur,  Jr.  Exact  moments  of  the  order  statistics  of  the  geo¬ 
metric  distribution  and  their  relation  to  inverse  sampling  and  reliability  of  redundant  systems. 
American  Statistical  Association  Journal,  62:915-925,  Sept.  1967. 

[3]  S.  M.  Ross.  Stochastic  Processes.  John  Wiley  &  Sons,  1983. 

[4]  K.  S.  Trivedi.  Probability  &  Statistics  with  Reliability,  Queueing,  and  Computer  Science  Appli¬ 
cations.  Prentice-Hall,  1982. 

[5]  V.  R.  R.  Uppuluri.  A  characterization  of  the  geometric  distribution.  Annals  of  Mathematical 
.Statistics,  35:1841,  1964.  (Abstract  61). 


15 


REPORT  DOCUMENTATION  PAGE 


Fofm  Approved 
0MB  No  0704-0188 


Public  r«portin|  burden  for  this  collection  of  information  is  estimated  to  averafe  i  hour  per  response.  includin|  the  time  for  reviewmi  instructions.  scarchin|  CKistinf  data  sources, 
gatherinf  and  maintaining  the  data  needed,  and  compictinf  and  reviewing  the  collection  of  information  Send  comments  reiarding  this  burden  estimate  or  any  other  aspect  of  this 
collection  of  information,  including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  Tor  Information  Operations  and  Reports,  1?IS  Jefferson 
Davis  hlighway.  Suite  1204.  Arlington.  VA  22202  4302.  and  to  the  Office  of  Management  and  Budget.  Paperwork  Reduction  Project  (0/04  0188).  Washington.  D<  20S0t 

1.  AGENCY  USE  OHCf(Leave  blank) 

2.  REPORT  OATE 

March  1994 

3.  REPORT  TYPE  AND  OATES  COVERED 

C'ontractor  Report 

4.  TITLE  AND  SUBTITLE 

ON  THE  MINIMUM  OF  INDEF’ENDENT  OEOMETRICALLY 
DISTRIBUTE!)  R.ANDOM  V.\RI.\BLES 

S.  FUNOING  NUMBERS 

('  NASI- 19480 

WU  .KI.I-OO-.U-Ol 

6.  AUTHOR(S) 

(liaiiFranco  Ciarclo 

Lawrence  M.  Leemis 

David  Nicol 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  AOORESS(ES) 

Institute  for  Computer  .Applications  in  Science 
and  Engineering 

Mail  Stop  l.'12C,  NASA  Langley  Research  ( 'enter 

Hampton,  VA  2.1681-0001 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

IC.ASE  Reporl  .No.  94-12 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  AOORESS(ES) 

.National  Aeronautics  and  Space  Administration 

Langley  Research  ('enter 

Hampton,  VA  'J.'1681-OOOI 

10.  SPONSORING/MONITORING 

AGENCY  REPORT  NUMBER 

NASA  CR- 19488.1 

K'ASE  Report  .No.  94-12 

11.  SUPPLEMENTARY  NOTES 

Langley  Technical  Monitor:  Michael  F.  ('ard 

Final  Report 

Sulmiitted  to  Statistics  and  Brobability  Letters 

1 12a.  OISTRIBUTION/AVAILA8ILITY  STATEMENT 

12b.  DISTRIBUTION  CODE  I 

U  ncla.ssified-  U  niimited 

Subject  Category  61 

13.  ABSTRACT  (Maximum  200  words) 

The  expectations  E[X^  |  j],  E[Z^  j  j],  and  flKj  | )]  of  the  iniiiiinum  of  n  independent  geometric,  modified  geometric,  or 
exponential  random  variables  with  matching  expectations  differ.  We  show  how  this  is  accounted  for  by  stochastic 
variability  and  how  £’[A'(  ]  )]/£'[V'(  |  j]  equals  the  expected  number  of  ties  at  the  minimum  for  the  geometric  random 
variables.  We  then  introduce  the  “shifted  geometric  distribution”,  and  show  that  there  is  a  unique  value  of  the  shift 
for  which  the  individual  shifted  geometric  and  exponential  random  variables  match  expectations  both  individually 
and  in  their  minimums. 

14.  SUBJECT  TERMS 

geometric  distribution;  exponential  distribution;  stocha.stic  ordering;  order  statistics 

IS.  NUMBER  OF  PAGES 

17 

16.  PRICE  CODE 

Ao:) 

17.  SECURITY  CLASSIFICATION 

OF  REPORT 

Unclassified 

IS.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE 

FInclassified 

19.  SECURITY  CLASSIFICATION 
OF  ABSTRACT 

20.  LIMITATION 

OF  ABSTRACT 

Hik  - Standard  Form 


FVcscnbcd  by  ANSI  Std  2^<i  18 
7Q8  10? 


